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Representation  Schemes  for  Investigating 


Non-linear  Processes 

by 

Donald  DeVorkin 


ABSTRACT 


The  work  is  concerned  with  systems  of  ordinary 
differential  equations.  A  framework  is  developed  in 
which  a  statistical  approach  to  the  analysis  of  the 
equations  is  natural.  One  seeks  the  correlations  of 
the  solution  in  terms  of  the  correlations  of  initial 
conditions  and/or  forcing  functions.  General  representation 
schemes  are  developed  for  this  purpose.  It  is  shown 
that  general  schemes  can  converge  for  arbitrarily  large 
but  finite  time.  In  some  special  cases,  all-time  repre¬ 
sentations  are  obtained. 
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INTRODUCTION 

(0.1)  Preliminary  Discussion 

At  the  present  time,  we  are  able  to  enjoy  the  results  of  extensive 
successful  application  of  linear  methods  to  science  and  engineering. 

This  is  not  to  say  that  even  essentially  linear  problems  necessarily 
yield  to  the  developed  analytical  methods  of  mathematical  physics.  One 
example  of  what  is  meant  is  that  we  can  solve  Laplace's  equation  analyt¬ 
ically  in  only  very  special  coordinate  systems.  Nevertheless,  since  we 
can  solve  many  linear  problems,  we  are  sometimes  able  to  deduce  general 
properties  for  a  class  of  problems,  suggest  meaningful  experiments,  and 
obtain  successful  engineering  methodology. 

The  situation  for  non-linear  problems  is  not  nearly  so  satisfactory. 
Some  very  special  problems  have  been  thoroughly  treated,  but  for  the  most 
part,  analytical  methods  have  been  available  to  English  readers  only  since 
our  introduction  to  the  Russian  School  by  Minorsky  (1947).  Since  then, 
although  numerous  books  have  appeared,  the  analytical  methods  available 
to  us  at  the  present  are  found  to  be  substantially  those  in  Minorsky 
(1947).  These  methods  have  one  common  aspect:  The  equations  must,  right 
to  begin  with,  be  in  some  sense  nearly  linear  in  order  that  the  methods 
apply . 

In  this  thesis,  we  will  attack  certain  classes  of  non-linear  problems 
from  a  different  point  of  view.  While  one  of  the  results  is  of  a  quasi- 
linear  nature,  the  rest  are  truly  non-linear  in  character.  These  results 
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contain  their  own  Inherent  limitations,  and  hence  will  channel  the  kinds 
of  physical  problems  to  be  considered. 

(0.2)  The  Statistical  Viewpoint 

Wiener  (19S8)  developed  a  means  for  synthesizing  a  class  of  non- 
linesr  networks.  We  can  characterize  this  class  by  the  properties: 

a)  Bounded  inputs  give  bounded  outputs. 

b)  At  the  present  time,  the  output  does  not  depend  on 
the  nature  of  the  input  acting  at  the  infinite  past. 

For  linear  networks,  one  has  become  used  to  the  Impulse  as  a  probe. 
That  is,  we  often  characterize  linear  networks  by  their  impulse  response. 
Wiener  shows  that  for  his  class  of  non-linear  problems,  Brownian  motion 
is  a  suitable  probe,  and  that  one  can  synthesize  these  systems  when  in 
possession  of  the  Brownian  motion  response.  One  describes  Brownian  motion 
by  its  statistical  properties  snd  what  is  really  required  for  the  synthesis 
procedure  are  input-output  cross  correlations. 

Let  us  try  this  sort  of  thing  for  a  linear  system 

•o 

3(t)  -  {  i.(t-'r)*(T)n 

-•O 

where  “X  (’t)  is  any  representative  member  of  an  ergodic  ensemble, 

and  [l  h  (-t)  |  d-t  exists  and  ^  oo 

—co 
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Then 


I$(i)  n(-t  +  (T) 


J  K(t  -  *r)  x(t)  x(,t+<r)<n 


The  bar  denotes  ensemble  =  time  average . 


For  the  case  where  the  ensemble  Is  white  noise 

X  (t+<r)x(T)  *  £  (T)  ■t  *  O 

«(t+*r)  =  -  t)  J  (T, -t  ht)  <JT 

=  Vi  (-  <r) 


To  obtain  h  (*t  )  ,  any  ergodic  ensemble  of  functions  whose 

auto-correlation  ia  a  delta- function  would  suffice.  Since  the  average 


<*(*)  x  (t  +<r ) 


can  be  taken  as  well  over  time  as  down  the 


ensemble,  only  one  representative  member  of  the  ensemble  need  be 
required . 


For  the  linear  system,  the  higher  order  moments  of  the  input  can 
be  left  arbitrary.  The  Wiener  theory  for  non-linear  synthesis  suggests 
Brownian  motion,  all  correlations  must  be  specified  and  there  is  no 
arbitrariness  at  all.  Schetzen  (1962)  has  shown  that  if  a  non-linear 
network  uses  up  to  n-th  order  products  of  the  input,  then  a  suitable 
probe  is  a  representative  member  of  an  ergodic  ensemble  whose  first 


2n  correlations  are  the  sane  as  for  Brownian  motion,  but  whose  higher 
order  correlations  are  arbitrary. 

Through  the  above  ideas,  which  are  primarily  concerned  with  network 
synthesis,  we  can  get  a  look  at  a  fundamental  issue  in  analysis.  To  do 
this  we  need  only  to  add  something  about  the  nature  of  a  Brownian  motion 
ensemble.  Each  member  of  a  Brownian  motion  ensemble  is  continuous  and 
defined  over  all  time.  Now  let  ^  be  a  continuous  function  defined 

on  an  interval  of  length  L  Then  almost  every  member  of  the  ensemble 
approximates  {  (t)  arbitrarily  closely  on  some  interval  of  length  L_ 

In  a  sense,  a  Brownian  motion  ensemble  is  very  large.  To  delineate  what 
is  meant,  we  construct  a  very  simple  ensemble. 

Let  there  correspond  to  the  oi  th  member  of  a  Brownian  motion 
ensemble,  a  function  {-(i)--C  ,  a  constant  independent  of 

Our  new  ensemble  has  as  many  members  as  the  Brownian  motion  ensemble,  but 
displays  no  variety  of  form.  The  greater  the  variety,  the  more  an  ensemble 
will  resemble  Brownian  motion.  Then  from  above,  as  a  network  employes 
higher  and  higher  order  non-linearity,  the  variety  of  form  displayed  by 
an  input  must  become  greater  when  it  is  required  that  the  response  of  the 
network  to  the  input  be  capable  of  characterizing  the  behaviour  of  the 
network . 

We  are  led  to  the  idea  that  for  a  system  which  makes  use  of  all 
orders  of  non-linearity  in  the  input,  every  input-output  situation  must 
be  analysed  as  a  special  case  when  deterministic  statements  are  required. 
Hence,  we  shall  in  this  work,  attempt  analysis  ammenable  to  statistical 
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description  of  the  output  or  solution  in  tens  of  statistics  of  the 
input . 


(0.3) 


Differential  Equations 


The  non-linear  systems  which  shall  concern  us  here  will  be 
supposed  given  by  a  differential  equation  or  by  a  system  of  differential 
equations.  Accordingly,  in  this  section  we  mention  a  few  standard 
ideas  of  use  in  dealing  with  ordinary  differential  equations.  To  begin, 
consider  the  linear  system  of  n  equations 


4f  *  A(t)x  +  fCt) 


where  X  and 
elements  may  be 

components  are 


are  column  n-vectors  and 
functions  of  H#  ,  and 

Jt 

dx-L 

dt 


A  Is  an  nxn  matrix  whose 
is  a  column  vector  whose 


Let  8 


be  any  nxn  matrix.  We  define 


e 
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where  I  is  the  Identity  matrix.  If  the  elements  of  B  are  all 

6 

finite,  then  the  series  which  defines  each  element  of  the  matrix  & 
converges  absolutely. 

A  B  ,  B  A  a  q 

Mote  that  in  general  e  6-  7-  6  &  unless  A  and  D 
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commute.  For  the  case 


BA 


A  B  - 


e 


A 


+  3} 
e 


These  statements  are  deducible  directly  from  the  series  definition  of 
0.  Since  A  commutes  with  A)  , 

-A  A  (A- A) 

c  e  -  e 


It  will  be  a  help  later  on  to  have  at  our  disposal,  the  Jordan 
Cannonical  Form  for  matrices  (Friedman,  1956).  However,  since  the  state¬ 
ment  of  the  theorem  is  rather  involved,  we  will  here  state  a  simple  case. 

Let  A  be  any  nxn  matrix  whose  n  eigenvalues  are  all  distinct. 
Then  there  exists  the  decomposition  of  A 

A  =  ED  E"' 

where  D  is  a  matrix  all  of  whose  elements  off  the  principal  diagonal 
are  zero,  while  the  elements  of  the  principal  diagonal  are  the  H  distinct 
eigenvalues  of  A  The  columns  of  E  are  the  right  eigenvectors 


o 

K 

> 

t 

rows 

of  E 

-1 

turn  out 

to  be  the  left  eigenvectors  of  A 

Let  "fc; 

be  a 

scalar, 

and  A  a 

constant  matrix.  Then 

At 

I  + 

A±  + 

aV  .  . 

£ 

1! 

3LI 

< 

where  A"t  is  a  matrix  each  of  whose  components  are  those  of  A 

multiplied  by 

One  can  define 

a  derivative  as  follows: 

- 

J-Tt  +  At  Ajf  . .  .1 

•hL1  1  11  zi  J 

r  a  .  aY  .  i 

LA  I!  +  3!  +  •'  ‘J 

= 

A  e  At 

The  Jordan  Cannonical  Form  allows  a  simplification  of  represen- 

tation  for  the  matrix 

eA  . 

If  A  = 

ede~‘ 

eA  - 

EDE*' 

e 

= 

r  +  eoE-  _  £M1)*+  . . . 

1  I!  J! 

= 

fIf+EDE  V  ED’e  '  4-  E°3E  +  •*• 
cc  1!  i\  3! 

1 

eC1*  £  +  if  +  it  *•••]£'' 

1 

E  eD  E''  . 

Since  the  eigenvalues 

of  A  are  assumed  all  distinct, 
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This  Is  a  staple  and  convenient  fora  of  €  .It  particularly  is  useful 
in  handling  ordinary  differential  equation  systeas  which  we  now  take  up. 

First,  consider  the  single  n-th  order  equation 


The  function  on  the  right  can  of  course  be  non-linear.  Let 


dX 

d 


—  d-A.i 
d 


dn-‘  X 

it'1"' 


X-  n 


d  *fc 
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We  now  have  a  system  of  equation* 


•  •  •  • 


By  the  change  of  variable*  introduced,  the  single  n-th  order  equation 
i*  tr ana formed  into  a  system  of  rt  first  order  differential  equations. 
However,  it  is  not  always  possible  to  transform  the  first  order  system 


•  «  »  i  • 


into  a  single  n-th  order  equation  of  the  form 


For  this  reason,  it  will  be  preferable  to  work  with  systems  of  first 
order  equations. 
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Let  f\  be  an  nxn  matrix  whoae  components  are  constants  independent 
of  time.  The  linear  homogeneous  system 


dX  _  A 

<u  J 


X  (o)  »  X  o 


is  solvable  as 


At  I  A't  \ 

X  (t)  ~  d.  Xe  since  from  above  - —  ( S.  X0  J  — 


=  AeAtx.  =  A* 


dfc 

A  (o')  T 

while  &  = 


so  that  X  (®)  =  3!  —  X0  ,  the  arbitrary  initial  condition  vector. 

For  A  still  a  constant  matrix  and  4(t)  a  vector,  a  partic¬ 
ular  solution  to  the  inhomogeneous  linear  system 


d  t 


—  A%  +  ((t) 

*  A  (t  -  ‘T) 


is 


(t)  =  ( 


{  Or)  a  t 


where  the  integration  is  carried  out  on  a  tern  by  term  basis  of  the 

Alt  -T) ,  . 

n-vector,  6.  "Tv.*/-  Note  that  Xp  (O)  ”  O.  That 

X  p  is  indeed  a  particular  solution  can  be  calculated  directly. 
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The  complete  solution  which  reduces  to  an  arbitrary  vector 
at  ■=•  O  is  thus 

tW  -  eAV0  +  j  eA(t'T)f(T)  AT 

e> 

Consider  next  the  system  of  first  order  non-linear  differential 
equations 

=  A*  + 

where  A  is  again  a  constant  matrix  and  is  a  vector 

whose  components  are  functions  of  ~fc  and  the  components  of  X 

It  is  also  supposed  that  *(o)  =  1 L,  Then  from  above 

x(t)  =  eASc0  +■  J  tA(jt  ^\[x(r)}T  ]  d  T 

o 

It  will  be  convenient  later  to  use  this  equivalent  Integral  equation 
formulation.  But  so  far  we  have  dealt  only  with  systems  whose  linear 
part  has  constant  coefficients. 


For  the  linear  system  of  n  equations 

=  A(t)  % 

it  is  known  from  the  theory  of  ordinary  differential  equations  that  over 
any  finite  time  interval,  there  exists  P  independent  solutions  which 
can  be  arranged  as  the  columns  of  the  nxn  matrix  H  ("t )  ,  and  that 
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any  solution  can  be  expressed  as 

X(t)  =  H(-fc)  y0 

Further,  the  inverse  of  M  (t )  exists  for  all  "fc  in  the  interval. 

H  Co)''  X  (o)  =  ^  ° 

X(t)  -  MC-t)  H-'(0)  X(o) 

In  an  analogous  manner,  the  system 

|f  =  A(-t)  +  U*,-fe) 

is  transformed  into  the  integral  equation 

X(t)  =  H(  t)  H"(o)  x(o) 

+  H(t)  L*C‘r),T]j'r 

o 

•ben  y  "t  ^  does  not  depend  od  X  ,  the  integral  equation 

becomes  that  particular  solution  to  the  linear  Inhomogeneous  system 

-  =  A  (+)  ^  -v-  (t) 

A  -t 

which  reduces  to  X  (_C?)  at  “t  »  O  . 
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h 


(0.4) 


All-Time  Repreaentation*  and  Volterra  Functional* 


A  functional  la  a  napping  of  a  function  apace  into  the  real  line. 
Let  ua  take  the  function  apace  to  be  the  aet  )(  of  contlnuoua  function* 

^  (t )  wlth  [o.  i  t  &  u]  Then  to  every  -£  ,  ia  made 

to  oorreapond  a  real  number  F[t-u)]  ,  called  a  functional. 

b 

We  call  an  expreaaion  of  the  font  |  K  C't)  d'k 


a  regular  linear  functional  on  the  function  apace 


K  (t)  ia 
th 


fixed  and  aaaumed  contlnuoua.  A  regular  homogenmoua  functional  of  n 

degree  ia  defined  analogoualy  aa: 
b  b 

’  •  Utn)  at,  •  •  '  d*„ 


Let 


F„[{]  be  a  regular  homogeneou*  functional  of  nth 

H 

degree.  Then  the  fora  If.Cf]  ia  called  a  functional 

0 

polynomial.  For  the  uaual  familiar  polynomiala,  we  have  the  following 
important  repreaentation  (or  approximation)  theorem  of  feieratraaa  aa 
atated  by  Apoatol  (1957). 

Let  ^  be  real-valued  and  contlnuoua  on  a  cloaed  interval 
^0l  ^  Ikon  *lven  any  G  O  >  there  exiata  a  polynomial 
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(which  may  depend  on  £  )  such  that 


Ut)-  POO 


C  (L 


for  every 


t 


in 


The  extension  of  this  theorem  to  functionals  was  already  known 
in  1910  by  Frechet,  and  in  all  probability  only  shortly  after  that  by 
Volterra.  We  will  state  the  functional  polynomial  approximation  theorem, 
but  must  first  discuss  continuity  for  functionals. 


Let  X  be  the  function  space  defined  above.  Further,  suppose 
a  metric  defined  on  X  ;  the  distance  between  {  (.  t)  and  3  00 
I,  denoted  by  ||(  —  ||  Then  a  functional  F"  on  X  la  continuous 

4 

at  ^  if  for  any  fc  C  ,  there  exists  a  ^  >  G-  )  such 

|FU]  “  F  [<%]  |  ^  €  whenever  ||^  -^||  <  $ 


that 


The  extension  of  the  Weiers trass  theorem  to  functionals  is  stated 
in  Volterra  (1959).  However,  the  statement  there  is  loose,  and  we  will  not 
directly  quote  him. 


Let  the  function  space 


be  as  defined  above;  and,  let  there  be 


a  metric  on 


such  that  any  homogeneous  regular  functional  on 


X 


is 


continuous.  Further,  suppose  that  with  respect  to  the  metrix  on  X  y 


F  U  } 

et  in  X 


is  any  continuous  functional,  and  that  L/  is  a  compact 
Then  given  any  G  >  O  ,  there  exists  a  functional 
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(which  may  depend  on  0  )  such  that 


polynomial  P(iJ  (which  may  deper 

F  R]  “  P  [^]  I  <  6  ^  all  *f 


It  is  seen  that  functional  polynomials  possess  the  same  repre¬ 
sentation  qualities  for  functionals  as  do  polynomials  for  ordinary 
functions . 

The  Stone-Weierstrass  theorem  is  an  abstract  general  statement 
which  contains  the  above  theorem  as  a  special  case.  Appendix  C  makes 
use  of  the  Stone-Weierstrass  theorem.  For  the  time  being,  let  it  be 
sufficient  to  say  that  Brilliant's  (1958)  topology,  used  in  conjunction 
with  the  Stone-Weierstrass  theorem,  Indicates  that  there  may  be  a  class 
of  functionals,  occurring  commonly  in  practice,  which  can  be  represented 

oo 

by  functional  power  series  of  the  form  I  p.m 

o  o  0=0 


*  4  (^,) - t(t")  d  't,  *  *  *  Jt  n 

The  difference  here  is  that  the  functions  4(t)  of  the  function  space 

X  are  now  defined  over  the  infinite  interval  oo  <  ^  ^ 

As  mentioned  earlier,  Wiener  (1958)  has  given  a  procedure  for  obtaining  the 
kernels  in  the  integrals  of  a  related  scheme  when  such  a  representation 
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exists.  There  are  certain  fundsmental  unreaolved  difficulties  —  even 
when  the  representation  exists  —  which  say  be  somewhat  relieved  with 
the  tools  developable  with  the  insertion  of  Brilliant's  (1958)  topology 
into  the  Stone-Veiers trass  theores.  Ve  will  pursue  these  lines  flirt her 
in  the  third  chapter.  Although  many  useful  non-linear  operators  aay  be 
representable  by  a  Viener  type  scheme,  we  shall  here  deal  with  problems 
for  which  nothing  so  nice  exists  as  a  uniformly  convergent  over  V 


functional  poa 


intation  when 


fW 


in 


is  defined 


over 


(—<-4  <  oj  . 


Our  interest  lies  in  non-llnesr  ordinary 


differential  equations  of  the  kind 


it  - 4  <*>*> 

where  is  an  n-vector,  and  is  an  n-vector  whose  coaiponents  are 

in  general  non-linear  functions  of  "fc  and  the  components  of  JL 

Tor  simplicity,  let  the  equation  take  the  form 

7T  -+<*>  *  l<‘) 


where 
"4  % 


Ct)  will  be  some  prescribed  function  of  time  and 
are  one-vectors.  Now  in  addition,  let  the  equation 


dx. 

cifc 


=  4c*) 


> 
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possess  two  asymptotically  stable  limit  points,  'X,  and  (  Xf 

and  are  one-vectors).  Associated  with  X(  is  a  region  R, 

and  with  a  region  Ra  such  that  if  X  (jh)  is  in  R,  for 

some  T  ,  then  X  ("k)  stays  in  R(  for  all  "t  >  I  and  asymp¬ 
totically  %  (jfc} — >  X|  ;  the  same  situation  obtains  of  course  for 

R  a  The  two  regions  are  clearly  disjoint. 


We  suppose  the  process  to  have  been  going  on  from  minus  Infinity 
until  now,  and  that  there  is  a  functional  power  series  representation 
for  *t>  *  now  s  O  .  The  initial  conditions  at  -oo  are  supposed  fixed 


independent  of  the  forcing  function  (4^)  .  It  =  F~ (x)  *+■  f^(t) 

then 

o 

x  <*)  =  K.  +  \  K,  ( t)  ^  (t)  d  t 

-oo 

- X  -OO 

where  K0  is  a  constant.  This  is  the  functional  power  series.  Also 

“  =  F  Gj)  +  ^  (i)  ,  then  we  eust  be  able  to  write 

e» 

tj  (c)  -  Kc  +  f  K,  c-t)  ^  tt)  At 


OO 

O  O 


+  \  j  J  tA)  1-1  (t.)  h  (tA)  At,  cJ  f 

—  UO  —  OO 

=  Z  K,|>] 


in  an  obvious  notation. 
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There  exlete  an  0  such  that  an  0  —  neighborhood  about  the  asympto¬ 
tically  stable  limit  point  % f  is  contained  in  R  j  ,  and  an  £  ~ 
neighborhood  about  is  contained  in  Rx  .  Also,  there  exists 

..  N(e)  such  that 

M  I 

(0 , 4  )  —  Y  n  J  I  <  ^  for  all 

e> 

N  and  all  ^  of  the  function  space. 

We  nov  choose  special  forcing  functions.  Let  drive 

the  solution  X  (-fc)  into  region  R  (  at  time  T  and  then  turn  off; 

for  “t  >  *T  .  Similarly  let  )r\  (i. )  drive 
<X_  ("b)  into  at  "t  ~  T  and  then  turn  off.  It  is  necessary 

here  to  take  and  HO  bounded  so  that  by  having  T  far 

enough  in  the  past  and  requiring  that  all  individual  Integrals  exist  we 
can  have  £ 

X,-x(o)  I  <  T 


N' 


Mo)-  I  K.fc]  |  <  f 

h  =  C 


h/ 


l  “-W 


G 

<  y 
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I  <  i 

|  <  -§- 

£k~I>]  |<  | 

rv«si 

This  implies  that  K 0  is  within  G  of  both  'X,  and  which  is 

the  required  contradiction.  It  is  to  be  noted  that  in  any  individual 
problem,  we  may  not  be  able  to  choose  parameters,  forcing  functions, 
etc.  as  required  above.  However,  there  will  be  some  not  at  all  patho¬ 
logical  equations  for  which  we  can  proceed  in  the  above  fashion.  This 
is  all  that  is  needed  to  Invalidate  functional  power  series  expansions 
as  a  general  approach.  Yet,  for  certain  statistical  investigations, 
one  is  reluctant  indeed  to  give  up  functional  power  series  schemes; 
for  the  forcing  function  appears  in  products  with  Itself  and  drawing 
averaging  bars  yields  output  correlations  in  terms  of  input  correlations 
directly.  Hence  in  the  remainder  of  the  paper,  we  shall  pursue  certain 
areas  where  the  special,  but  nevertheless  important,  situations  allow 
of  a  representation  in  a  form  particularly  suited  to  statistical 
investigation. 

(0.3)  Content  and  Form  of  the  Thesis 

The  introduction  itself  is  to  serve  two  main  purposes.  The  first 
of  these  is  to  introduce  the  reader  to  the  problems  and  limitations 
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involved  in  attempting  to  obtain  general  solutions  of  non-linear  equa¬ 
tions.  These  difficulties  have  caused  the  author  to  adopt  certain  points 
of  view.  For  example,  the  discussion  on  the  statistical  approach  in 
section  (0.2).  This,  and  certain  ideas  stressed  in  the  introduction, 
should  serve  to  orient  the  reader's  point  of  view  sufficiently  to  obviate 
the  need  for  re-stressing  in  the  remainder  of  the  paper.  So  that  again 
by  way  of  example,  it  will  be  supposed  throughout  the  body  of  the  thesis 
that  the  reader  is  himself  capable  of  drawing  ensemble  average  bars  in 
order  to  obtain  statistics  as  any  given  situation  does  or  does  not  require. 

The  second  major  purpose  of  the  introduction  is  mathematical  in 
nature.  Here  it  is  hoped  that  a  reader  not  already  adequately  prepared 
will  gain  some  mathematical  ideas  and  manipulations  to  serve  as  background 
for  the  thesis.  Much  of  this  material  perhaps  need  not  be  explicitly  used 
in  reading  through  the  body  of  the  thesis.  Nevertheless,  it  may  prove 
valuable  background,  especially  should  the  reader  wish  to  use  the  results 
on  his  own  problems . 

Chapter  I  deals  with  a  pertubation  procedure.  The  method  is  in¬ 
herently  quasl-1 Inear  in  nature.  However,  it  does  give  an  Important  area 
for  which  an  all-time  representation  is  possible.  Chapters  II  and  III 
give  results  which  are  truly  non-linear  in  character.  The  general  state¬ 
ments  will  here  hold  for  only  an  arbitrarily  large  but  still  finite  length 
of  time.  Of  course  from  section  (0.4)  this  is  to  be  expected. 

In  Chapter  II,  a  condition  is  given,  the  satisfaction  of  which 
allows  of  approximate  solutions  which  converge  uniformly  over  all  time. 
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This  restriction  is  simply  that  for  any  finite  Initial  conditions,  and 
zero  forcing  function,  the  system  damps  asymptotically  to  zero.  Under 
this  condition,  Chapter  II  gives  an  all  time  representation  scheme  for 
analytic  systems  without  forcing.  When  the  condition  is  not  fulfilled, 
the  scheme  converges  uniformly  over  any  arbitrarily  large  but  finite 
time  Interval. 

Chapter  III  presents  a  finite  time  representation  scheme  for 
analytic  systems  with  forcing.  The  difficulties  of  an  all-time  Volterra 
expansion  are  again  considered. 

The  physical  problems  discussed  have  been  included  only  to  illus¬ 
trate  applicability  of  the  abstract  statements.  In  each  case,  the  problem 
is  briefly  set  up.  It  is  hoped  that  later  work  will  carry  out  the  indi¬ 
cated  procedures  and  obtain  physically  significant  results. 

One  further  remark  about  the  examples.  Field  problems  of  the  kind 
dealt  with  here  are  formulated  by  partial  differential  equations.  These 
represent  a  non-denumerable  infinity  of  equations.  However,  we  shall 
always  suppose  that  high  frequency  effects  are  negligible  and  that  for 
physical  purposes  we  could  approximately  represent  the  problem  by  a  finite 
dimensional  mesh  Bpace,  or  by  say  a  finite  number  of  Fourier  coefficients. 
The  reader  can  suppose  that  any  Infinite  space  is  approximable  by  a  finite 
one,  so  that  Fourier  transforms  of  probabilistic  functions  necessarily 
exist.  However,  the  theory  of  formal  Fourier  representations  (Lighthill, 
1959)  can  be  Invoked  should  an  infinite  space  and  rigorous  approach  be 
desired. 
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Finally,  proofs  which  sre  unduly  long,  complicated,  or  mathematical 


have  been  relegated  to  the  Appendices.  The  Appendices  themselves  are  mathe¬ 
matical  in  nature.  Terms  and  Ideas  which  are  standard  are  there  used  without 
elaboration. 


22 


Chapter  I 


(1.1)  An  Asymptotically  Stable  Limit  Point  Theorem 

It  has  been  very  common  to  attempt  pertubation  solutions  about 
a  linear  solution,  for  the  most  part,  when  this  Is  done  in  the  liter4- 
ature,  the  convergence  of  the  procedure  Is  simply  assumed.  In  this 
section,  we  present  a  pertubation  procedure  for  a  class  of  problems 
whose  convergence  is  given  in  Appendix  A. 

The  basic  system  with  which  we  shall  deal  here  ie  given  by 
the  equation 

o.u)  -  A*.  + 

d  t 

x(o)  =  xc 

In  this  equation,  all  quantities  are  continuous  functions  of  time . 
X.(-t)  and  g(t)  are  n- vectors .  is  a  constant  nxn  matrix 


and  GW  is  a  time  dependent  nxn  matrix.  hO.  *  w] 


is 


a  vector  whose  components  are  each  a  polynomial  in  the  components 
of  %.  .  These  polynomials  are  at  least  of  second  degree;  there  is  no 
linear  dependence  on  the  components  of  X,  The  coefficients  in  the 
polynomials  are  bounded  functions  of  time. 


There  is  a  condition  on 


It  is  that  the  eigenvalues  of 


all  have  negative  (not  sero)  real  parts.  This  condition  in  physical 
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terns  is  simply  that  the  system  have  linear  friction.  We  will  come  back 
to  a  discussion  of  the  terms  in  the  equation  later.  Now  we  wish  to  state 
a  theorem  which  provides  a  means  of  solution  of  (1.11)  under  certain  cir¬ 
cumstances. 


We  use  the  notation 


II  nil 


to  denote  a  scalar  which  equals 

fl  be  a 


the  largest  magnitude  of  any  of  the  components  of  n  whether 
vector  or  matrix. 


Theorem  I 

For  equation  (1.11),  there  exist  positive  numbers  fi,  ,  Q  ,  and 
C ,  each  >  O  such  that  If 

IK*  II  <  R 

|j  0  (t)  1 1  <  Ca  tor  all  "t 

H§ft)||  <  3-  *”*“  * 

then  the  equation  can  be  solved  by  the  following  successive  approximation 

scheme : 

*,(*)  is  the  solution  to 

— 1  =  A-*,  +  ^(t)  ,  x,(o)  =  x „ 

while  for  n  s£  I 
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d  *VIH 

dt 


A +  G»  U)  4-  H[t  ^n]  + 


“X-r\tt  (0)  ~  ^  o 

The  successive  approximation*  converge  to  the  solution  -X  (t)  uniformly 
over  all  time. 

This  theorem  is  proved  in  Appendix  A.  A  more  general  statement 
appears  at  the  end  of  Appendix  A  with  the  above  theorem  as  a  special 
case.  In  practice,  the  applicability  of  the  hypothesis  of  the  general 
stateatent  will  be  too  hard  to  determine.  The  case  presented  here  will 
be  useful  in  many  applications. 

We  return  to  the  requirement  of  the  negativeness  of  the  eigen¬ 
values  of  A  Under  this  condition,  the  linear  equation 

(i.i2)  =  A*.  ^  (t) 

whose  solution  is 

d.13)  %(i)  =  j  eA(*‘TV‘r>  dT 

0 

basically  controls  the  situation  for  the  non-linear  equation  (1.11) 
subject  to  the  smallness  requirements  of  the  theorem. 

Let  us  examine  the  solution  to  the  linear  problem  (1.12).  For 
simplicity  we  suppose  the  eigenvalues  of  A  not  only  negative  but 


25 


At 

•Iso  distinct.  Than  £,  can  bo  written  in  tbs  fora 


At  Q 

e  =  Be 


Dt  g-1 


X,  0  • 

shore  D  is  •  diagonal  aatrix  /  Q  X  L  • 


tiao  lndopondont. 
(1.13)  bocoaos 


•  •  •  •  • 

•  •  »  •  • 

O  o  •  • 


o\ 

O 

0 

X./ 


,  and  is 


Define 


*(t)  =  8cotB*'t.+  [  Be?lt'T)B"^CT)  JT 

=  B''x.  =  B’'x(p)  =  ^(o) 
e‘'[3(t)]  =  h(t) 


this  produces 


D(t-T) 


a  w)  ^(t)  =  eDty.  +  [  e'''  'R(T)d'r 


Or,  on  •  ccaponent  basis 


(1.141) 
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» 


From  this  and  the  condition  X  *L  ^  O 


> 


we  obtain  the  bound 


ht(t)|  <  1 31(0)  | 


By  choosing  bounds  lor  the  initial  conditions  and  the  forcing  function 
saall  enough,  we  can  keep  ^(t)  uniformly  bounded  as  small  as  we  wish 


over  all  time.  This  implies  the  same  thing  for 
Changing  (1.12)  to 


x(-k)  -  6  • 


<l‘l8>  df  =  A*  +  &U0*  4  cj(t) 


does  not  alter  the  situation  as  long  as  Q \  (fc)  is  bounded  small 
enough  over  all  time.  This  can  be  proven  separately  from,  but  in  the 
same  way  as,  the  theorem  stated  above  and  is  proven  in  Appendix  A. 

Now  we  have  the  feeling  that  as  long  as  a  linear  solution  stays 
small,  it  ought  to  be  a  good  first  approximation  to  a  non-linear  equa¬ 
tion.  And  indeed,  the  theorem  shows  this  to  be  true. 

Por  the  equation  (1.11),  the  vector  point  ■')C('b')  =  0  is 

a  solution  for  ("t)  :=  Q  .  “X-  —  0  ia  called  a  limit  point. 

But  actually  in  our  problem,  it  can  be  shown  (Coddington  and  Levinson, 
1955)  that  under  the  conditions  of  the  theorem  (smallness  of  , 

&  (*)  ,  and  ^  ("fc)  ),  should  ^  (fc)  —  0  for  all  fc  >  fc,  f 

then  each  solution  tends  asymptotically  to  0  The  requirement 
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of  X*t  <  0  is  essential  here.  X  a.  0  ia  further  designated 

as  an  asymptotically  stable  limit  point. 


The  theorem  which  we  have  discussed  here,  proceeds  along  much  the 
same  lines  as  many  stability  or  asymptotic  behavior  theorems,  (Codding ton 
and  Levinson,  1955;  Lefschetz,  1957;  Birdgland,  1961).  It  is  presented 
here  for  a  number  of  reasons.  Firstly,  the  theorem  as  presented  here  is 
in  a  fora  particularly  useful  for  application  to  physical  problems.  But 
secondly,  asymptotic  behavior  theorems  require  the  forcing  function  to  go 
asymptotically  to  a  constant.  We  do  not  require  this  for  the  theorem  here, 
and  hence  are  led  to  a  somewhat  different  theorem.  This  has  been  done 
because  we  have  in  mind  statistical  problems.  To  illustrate  this,  we  go 
back  to  the  successive  approximation  scheme. 


(1 . 16n) 


Xryri 

<K 


A***,  +  G(t)*n  +•  H[t  ,  +-  <^(t)  , 

*n+,  (O)  =  ' 


This  is  equivalent  to 


(1 . 17n) 


'Kntl  ("t)  = 


eAV.  +  [eAlt'T>G.(T)if.CT)«|T 

+  feA(*'T)H[T,  x„cr)]j  r  +  j  eA(t  Tg(T) JT 

:  o 


The  first  approximation  is 


At 


(1.171) 


=  e  x. 


A(t-T) 


^(T)<1T 
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Since  H  £  T"  j  'X*  i»  a  polynomial  in  the  components 

of  Y  f1  the  successive  approximations  will  produce  components  of 
X.  r\-t- 1  in  terms  of  products  of  the  components  of  Xe  and  ^  (t) 

Tor  instance, 

*.(<>)  ^3  Co)  ^  ,  (fr,  )  ^  ,  O.)  *  (T,) could  be 


one  such  term. 


Products  like  Xj  (t  +  X)  are  approximated  uniformly 

over  time  and  over  all  properly  bounded  initial  conditions  and  forcing 
functions.  Hence  the  nth  approximation,  taken  over  an  ensemble  average 


gives  in  terms  of  ensemble 

...r....  m»  *,(o)  *,(0)3, (t;)  (rj  3, (r,)  (X>  . 

converges  to  (fc)  (t  +*  X*) 

uniformly  over  all  tine  and  all  sufficiently  bounded  ensembles  of 
initial  conditions  and  forcing  function. 

In  this  way,  one  successively  approximates  the  output  statistics 
in  terms  of  the  input  statistics.  A  special  but  Important  situation 

presents  itself  immediately.  Suppose  that  G?  0  and  xj 

is  not  explicitly  a  function  of  t  ,  H  =,  j-|  (%)  • 
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Suppose  further  that  all  input  atatistica  are  atationary.  Then  all  output 
atatiatica  will  alao  be  atatiohary  aa  "t  — >  ©o  .  That  la,  a  atatlatic 

will  go  to  a  definite  Halt,  dependent  on  X  ,  aa  "t  — >  oo  • 

(1.2)  Viacous  Incompreaaible  Two-Dimensional  Water  Wavea 

As  an  example  of  the  possible  application  of  the  foregoing  theorem, 
we  here  set  up  an  approximate  viscous  incompressible  water  wave  theory. 

There  is  however  a  serious  approximation  into  which  we  are  forced 
right  from  the  beginning.  It  is  that  we  will  try  to  describe  the  problem 
in  terms  of  a  scalar  potential.  This  procedure  would  of  course  be  correct 
in  the  lnviscid  case.  In  fact,  special  stress  combinations  will  produce 
curl  free  motion,  and  in  these  cases  the  problem  can  be  formulated  by  the 
scalar  potential.  It  is  felt  by  the  author  that  there  are  difficulties 
with  the  classical  viscous  linear  problem  (Lamb,  1932;  Handbuch  der  Physik, 
1960).  The  classical  methods  do  not  give  the  same  results  as  those  obtained 
here  for  the  linear  problem  forced  by  a  special  curl  free  motion  producing 
stress  configuration.  Hence  at  a  later  time,  it  is  hoped  that  the  classical 
method  for  the  linear  problem,  as  well  as  the  procedure  below,  will  be 
checked  by  machine  computation. 


30  - 


The  defense  of  an  approximation  such  as  we  use  here  must  ultima¬ 


tely  rest  on  the  fact  that  it  can  actually  be  carried  out,  and  that  at 
least  the  form  of  the  results  is  more  or  less  what  one  would  expect. 

It  will  be  easily  seen  that  as  the  viscosity  goes  to  zero  and  the  ampli¬ 
tudes  become  inf initessimal,  the  procedure  yields  the  correct  linear 
invisoid  model . 

Let  the  depth  of  the  water  be  infinite  at  2^.  —  —  oo  .  ^  -  Q 

is  the  mean  value  of  the  surface.  The  lateral  dimension  is  X  There 
is  no  dependence  on 

If  u.  stands  for  the  velocity  along  the  x-Axis  and  uj  the 
velocity  along  the  axis,  the  incompressibility  of  the  fluid  intro¬ 
duced  into  the  equation  of  continuity  gives 


(1.21) 


a* 


The  force  equations  are 


«.».)  ia.  +  uia  +  =  r  'if  +  /v\i 


and 


(1.22b)  +  u-iiii  +  *0^0  _  r  _  j_ 

cH  &  %■  d  }  3 

where  P  is  pressure,  y3  is  density,  and  and  are  body 

forces  in  the  X.  and  ^  direction  respectively.  ■/*  is  the  coefficient 
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of  viscosity  and  assumed  small.  In  particular,  these  equations  hold  not 
only  throughout  the  fluid,  but  hlso  at  the  surface. 


The  kinematic  condition  at  the  wave  surface  requires  that  a  particle 
on  the  surface  resutins  on  the  surface.  If  ^  j  'b  )  1«  the  de¬ 

viation  from  the  mean  of  the  amplitude  of  the  surface  motion 


(1.23) 


3*1  .  u  M 
37  7* 


U)  «  0  . 


There  are  two  other  conditions  on  the  problem.  They  are  the  stress 
conditions  normal  and  tangential  to  the  boundary  surface.  These  will  be 
determined  ultimately  from  the  stress-rate  of  strain  relations. 


(1.24a) 

(1.24b) 

(1.24c) 


-p  + 


To  obtain  the  required  relations,  we  pick  an  arbitrary  point  on 
the  wave  surface  and  draw  two  sets  of  rectangular  axes  each  of  whose 
origins  is  located  at  the  point.  The  first  set  of  axes  are  horizontal 
and  vertical  -£.-^,-axes  respectively.  The  second  set  of  axes  are  drawn 
such  that  the  OC  -  axis  is  tangent  to,  and  the  j  -  axis  is  normal  to 
the  wave  surface  at  the  chosen  point.  If  6  is  the  angle  betwmen 


32  - 


the  X-  and  X  -  axes,  then 


A2Z  *  tan  9  t  9 
X 

for  snail  enough  angles.  itself  is  not  allowed  large.  The  con¬ 

dition  tu-n  e  o  is  a  smoothness  condition  on  'Xj 


Remembering  that  =  ^  X  >  anc*  u®in8  the  transformation 

relations  of  Cartesian  Tensor  Analysis  (Jeffreys,  1931),  we  have  after 
neglecting  terms  with  factors  of  squared  and  higher  orders  in  0  , 


(1.25a) 

P  ,  ,  - 

P  _  n 

zv 

3  y. 

(1.25b) 

II 

P  +  M 
V  o>* 

We  still  do  not  quite  have  the  relations  we  want.  By  expanding 
in  a  Taylor  series  and  retaining  only  through  second  order  non-linearity, 
(1.25a,b)  become  respectively 


<1“*> 


-  PU 


+  J/=>v- 


di'y 


+  I! 

y° 


-  a /os 


j)  ■v  L  3  - ' 


/  £  x, 


(1.26b) 


Ju\ 

<**) 


Tra 


j>2  /Ju> 


(1.26a, b)  ara  tha  required  atraaa  relations. 


Va  will  first  taka  up  tha  case  of  saro  boundary  stress.  Proa  (1.26a) 
m  obtain  the  pressure  at  tha  surface  in  terns  of  tha  velocity  coaponents 
sad  tha  amplitude  /Yj 

It  is  assumed  that  neither  nor  the  velocity  components  or 

their  derivatives  are  large.  Also  V*  is  very  very  snail.  Our  major 


approximation  then  is  that  \  will  be  not  quite  but  nearly  equal 

to  aero.  We  will  come  back  to  this  later;  but  in  the  immediately  following 
discussion,  (1.26b)  will  be  dispensed  with  entirely. 


At  this  point  we  Introduce  the  scalar  velocity  potential 


U)  s. 


The  force  equations  (1.22a,b)  become 
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To  obtain  this  wa  have  uaad 


vhlla 


"?  »  -  ru  b-'V] 


y  (J)  a  0  froa  the  lncoapressibility  of  the  fluid. 

This  relation  holds  throughout  the  fluid,  and  in  particular 
at  the  surfaee.  With  the  aid  of  (1.26a)  wo  obtain  through  second 
order  non-linearity 


(1.28) 


+  v  -  ±|7i*  f  +  T] 


-  j»  * 


...a  v 

y\y° 


•Kr 


■HJ-. 


kl 

3=°s* 


In  (1.28),  consider  the  operator  defined  by 


ill  +£*|  v  ,  (T+fli)  — 

3*0 

Here  X  is  sinply  the  identity  operator.  How  if  the  operator 

is  in  sows  sense  snail  enough,  then  the  Inverse 

of  the  operator  ,  can  be  obtained  as  (Friednan, 

1956) 


-  O 


-  35 


Without  hesitation,  we  make  the  smoothness  assumption  that 


— 1 
*3  J 


is  a  bounded  operator.  Then  since  'Tj  has  already 


[ 

been  supposed  very  small,  the  operator  |  ^  •+>  ^  ^ 


can  be 


Inverted  as  described. 


Again  through  second  order,  (1.28)  becomes 


(1.29) 


<)t 


+  ^^'3  =  0 


N  1 


*4-  «3V 


?L 


'y 


-  u 


iV  _ 


1^=0 


=  0 


In 


terms  of  the  potential  $  ,  the  kinematic  condition  (1.23) 


through  second  order  is  given  by 


We  have  now  only  to  set 

$(*,*,*)  =f^Well,*£lk'3'dk 

~oc 

OO  % 

rj{k,T-)  =  (^K(i)  e  dk 

.nd  .ub.tltut.  In  (1.29)  »nd  (1.30).  »otlc.  tint  V  <t>  (*)  %t  b)  ~  0 
which  is  the  incompressibility  requirement. 


(1.29)  goes  over  to 


-  *Vk  +  avV4>i. 

(1.31)  Jt  a 

«-«5 

+  av  fli’l 

-  OO 

-90 

And  (1.30)  transforms  into 


42«  +  |v|$»  +  fWt'Vi 

(1.32)  J-fe  -i,  * 

+  \.L  a  -  o 
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(1.30)  and  (1.32)  are  In  the  required  fora  for  the  theoren  to  apply, 
except  that  they  represent  an  .infinite  nuaber  of  equations.  For  the  eigen¬ 
values  of  the  linear  part  are 

x  =  Yka 

^  The  cut-off  frequency 


for  k  !■  not  large.  As  discussed  in  section  (0.5)  of  the  Introduction, 
for  any  given  nuaerical  problem,  only  a  finite  nuaber  of  equations  would 
be  used.  Hence  we  can  suppose  that  for  any  practical  purpose,  the  succes¬ 
sive  approxiaation  scheae  given  by  Theorea  I  will  converge  uniformly  over 
all  time  and  sufficiently  saall  V(°i  *")  and  %)  ■ 


It  is  to  be  noted  that  in  any  practical  problea,  we  aust*  be  able 
to  find  a  ta  |  >  O  such  that  setting  “  O  lor 

is  a  reasonable  approxiaation.  Then  since 


^  |W|  |#k| 


aw 


we  will  have 


ii. 


uniformly  bounded.  This  substantiates  the 


Inversion 


/  T  +  n±\ 

of  the  operator  ^  1  T*  /  ••  carried  out  >bov*> 

and  allows  X  to  be  approxlaately  -  vV  ±  *L  VT^w|  . 
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Still  neglecting  for  a  moment  the  boundary  condition  (1.26b), 
email  but  not  identically  aero  in  (1.26a), 
and  inveatigate  the  linear  problem. 


let  us  take  P ^  ^ 


The  linearized  equivalent  of  (1.31)  and  (1.32)  with 


^  hi 


p^(*-)  included  are 


a.  33,  ip  +  -}%  =  -i-f  P^We 


-iW«. 


n 


(1.34) 


+  ihKi 


=  o 


Suppose  that  we  solved  this  linear  problem,  and  then  substituted 
the  results  into  the  linear  approximation  for  the  boundary  condition 
(1.26b).  It  is  the  condition  which  we  have  neglected  so  for,  and  would 
lead  to  the  requirement  on  I  g  % 


fW  *  P 


i 


X  that 


fj*  -MS  *$) 


Hence  for  any  small  enough 


,  there  exists  a  i  ^ 

such  that  the  linearized  motion  is  curl  free  and  given  by  a  scalar 
potential.  But  the  same  can  be  said  for  the  non-linear  problem. 

We  equate  the  left  hand  side  of  (1.31)  to  ”  00  and 


a  Pi 
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solve  this  equation  together  with  (1.32)  by  meant  of  Theorem  I. 

P  )  i 

Substitution  of  the  result  into  (1.26b)  gives  the  condition  on  •  g  %. 
such  that  one  has  potential  motion,  and  hence  has  actually  solved 
the  problem. 

Although  only  a  very  restricted  class  of  problems  can  be  handled 
in  this  way,  the  method  may  furnish  some  clues  about  the  non-linear 
relation  between  the  wave  spectrum  and  the  input  energy  spectrum. 


Chapter  II 


j 

j 


i 

i 


(2.1) 


An  Initial  Value  Problem 


We  will  now  turn  our  attention  away  from  pertubation  procedures 
and  obtain  a  truly  non-linear  result.  The  problem  under  consideration 
is 


(2.11) 


where  4  U;'*') 


=  4  (4;  X)  ,  Oc(c)  =  Xc 

is  an  n-vector.  The  components  of  4  are  each 


analytic  functions  of  "t  f  *  *  *  j  n  over  some  rectangle  K? 

It  |  <  -r 

|  4  R-t  ,  l  =  I, 

This  means  that  for  any  fixed  point  in  R  each  component  of  4*  ia 
an  analytic  function  in  each  variable  taken  one  at  a  time. 


Note  that  we  require  in  addition 


0  There  is 


no  forcing  function  for  (2.11). 


For  the  solution  to  (2.11),  we  will  obtain  a  representation 
theory.  The  proof  depends  upon  two  major  known  theorems.  The  proof 
itself  is  an  immediate  result  of  the  statement  of  these  theorems. 

The  first  theorem  needed  is  due  to  Poincare  (Lefschetz,  1957). 
One  result  of  this  theorem  as  applied  to  (2.11)  is  as  follows: 


41 


l«t  T  and  R  be  defined  m  above.  Let  0  be  a  rectangle 
of  Initial  conditions  defln'ed  by 

Os|n.(e)i|<  6i^  R;  ,  i- 

be  suppose  that  the  8*  have  been  so  chosen  that  If  %Xp)  originates 
in  B  ,  then  the  solution  for  0  ^  ^  J  —  T  remains  In  R 

Then  about  each  point  in  6  ,  there  exists  a  neighborhood  N  (.^  • ) 
such  that  each  component  of  the  solution  is  an  analytic  function  of 

*  )  *•»>  )  *  *  *,  for  O  S  t  <  d 

The  second  theorem  we  require  is  a  result  from  the  theory  of 
aeveral  complex  variables  (Bochner  and  Martin,  194«).  First  let  us 

define  the  rectangle  cl  *  8  as 

O  Sl+1  «  <1 

O  s|l£.i|  -r  fi;  ,  i  =  [ ,  i ,  •  •  •  ,n 

Then  we  can  state  the  theorem  as: 


Theorem  II 

If  a  function  of  several  complex  variables  la  analytic  in  each 
variable  separately  at  each  point  of  a  rectangle  such  as  jx 
above,  then  the  function  is  analytic  simultaneously  in  all  variables 
over  the  whole  rectangle. 
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The  theorem  means  that  the  function  can  be  represented  as  a 
multiple  power  series  in  the  n  +  I  variables.  Bach  component  of  the 
solution  to  (3.11)  Is  given  by 

(«.«>  *at)  *  I c‘ . . . *-,(<>/'•  •  •  *.co)V 

PH-  ' 

This  series  converges  absolutely  and  uniformly  over  any  cloeed  rectangle 
such  as  O  ~  |  |  —  C  ^ 

O  2=  |*-4|  <  Ai  *=  6;  ,  i- 

contained  in  *  B 

An  analytic  function  of  several  complex  variables  has  many  of 
the  properties  of  a  function  of  a  single  complex  variable.  For  instance, 
the  partial  derivative  with  respect  to  any  variable  can  be  found  by 
changing  the  order  of  differentiation  and  summation.  The  resulting 
series  is  also  absolutely  and  uniformly  convergent  over  the  same  closed 
rectangle  as  the  original  series.  The  same  holds  for  sny  number  of 
partial  derivatives.  Further  one  can  sum  over  all  indices  simulta¬ 
neously,  or  sum  over  one  index  completely  first. 

Let  us  return  to  (2.12)  as  a  form  of  solution  for  (2.11).  Since 
order  of  operations  like  summation  and  differentiation  is  inmaterial, 

and  O  implies  1C.(t)  ■  0  ,  **  can  represent  the  solution 

to  (2.11)  as 
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n  •  r\  a 

(2.i3)  t)  -  I  Z}  (0  Xj(c)  +  ]T  ^  C^*>**lo)*j.(P) 


non 


+ 


«  #  • 


n  n 


At  *t  —  O  this  becomes 

X;  (0)  =  1  C>)  *j  t°)  +  I  Y  C'H,(.0)  tj,  (o)  *.j,(°) 

J.l 


n  n  n 


J 1 1,  cl  w>(o)  *>■ (c)  V°)  V°> + •  •  • 


Since  the  relation  suet  hold  for  ell  X  in  6  .  We  obtain 


(2.14) 


c;  1°)  =  I  ;  Cjlo)=  o  ,  i** 

C- ;  (o)  =  C  ip)  =  •  •  •  =0 
H'K '  W'M»W 

When  we  aolve  for  the  C  S  >  (2.14)  will  be  the  initial  conditiona. 

Now  in  (2.11)  aince  ^  Ct,  *■ )  la  analytic,  and  {(V>)  =  0 
we  can  also  represent  jc)  as 
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n 

<2is>  -fat,*)  = 


V\  *\ 


X  *■}•  W  tj.!  (t) 


n  rt  n 


+X I  Wtj.Ct)t  JtWt)  +  •  •  • 

We  use  (2.15)  for  ~V  (^j  'X- )  and  (2.13)  with  the  conditions  (2.14) 
for  x{+)  in  (2.11).  The  resulting  equation  must  hold  for  all  x(o) 


This  deternines  that 


«,«>  jKw-  f^(octw,v 

1“ 


fixed 


u  -  1,  a,  ‘  " 

cUo)  «  0  ,  <-  *  ». 
Cl  (0)  =  I 


(2.152) 


—  c  - 

Ai.  “ 


V»  * 

♦  tt  ««.<•<  <“  .  KK.~ 

c  ^.(p)  •  o 


45  - 


(3.153) 


i  cU. 


c1; 

fi  ^ \  V'x  *•*«-  K* 

+iiSw<<< 

Jv-l  »  1  1 


vhara  k,  and  and  VA  ara  flsad; 

C*...w.Co)  *  0  . 


i  *  t,  i, 


(3.15a) 
a>  1 


a 


A*  C-*.  •••*..  -  X  CO  C^  ...  K 


*--•  * 

+’  1  *.•••*»  , 

'>»•»•'•  >  " 

j.  *'»WllCO)  -  0 

whore  Q.  .  (O  la  a  forcing  function  which  daponda  at  aoat 

a*"*' 

on  C  I  alraady  datarainad. 


Va  wish  to  aaphaaisa  a  faatura  of  (3.15n).  In  tarns  of  tha 
unknown  Ch|  ..(i0  tha  aquation  is  linaar.  Wa  can  rawrita 
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(a.ISn)  as  an  operator  equation 


(2.16n) 


l  *  l 


•S  i 


n 


where  L.  ia  a  linear  operator.  The  iaportant  thing  is  that  L.  does 
not  depend  on  ft  Hence  in  any  given  problem,  one  determines  the 

inverse  to  L_  only  once,  and  then  operates  each  successive  step 

with  L  on  the  already  known  forcing  function.  When  the  coefficients 
of  the  linear  term  in  the  expansion  for  4  given  by  (2.15)  are  constants, 
the  Inverse  operator  is  particularly  simple.  In  this  case,  (2.16n) 

beoosMS 


i-c; 

i  i  v  H  •  .« 


(2.17n)  ''H,...  m, 

n>l 


n  • 

—  ^  .1  ^ 

4 


V?, ,  •  •  •  )  W  fixed 

i  *  »,  A,  *  *  ’  }  n 

d  „  (o)  -  o 


The  solution  to  (2.17n)  la  vector  form  is 


<*•“»>  Ck....k„  W 

n>l 


CO  JT 
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where 


Cw  ... 


K  n 


and 


are  n-vectora  whose 


components  are 


c 

^  K,  •  *• 


and 


respectively; 


is  a  matrix  whose  components  are  • 


(2.2)  Conservative  Two-Dimensional  Vorticity 

We  here  follow  Lorenz  (1953).  The  motion  is  assumed  incompressible 
and  confined  to  the  X  ~  ^  plane.  Hence  the  velocity  components  can  be 
obtained  from  a  stream  function  ^ 

it 

Velocity  in  the  direction  ■  U.  •  —  - — 

Velocity  in  the  direction  «  V  * 

Taking  the  curl  of  the  force  equations  (1.22a,b)  we  obtain  the 
vorticity  equation 


(2.21) 


It  is  supposed  that  there  are  no  boundaries .  The  equation  holds  over 
the  whole  plane .  Hence  we  represent  ^  by 

-c  <*> 
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This  leads  to 
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We  shall  however,  ba  Interested  in  the  quantity 


(S)  =  l-1* 


(«>W)  t,*  H-: 


which  is  the  energy  density  over  time. 


Let  us  return  to  the  fundamental  equation  (2.221).  This  equation 
is  of  the  form  required  by  Theorem  II,  except  that  it  is  an  infinite 
system.  We  again  adopt  the  attitude  that  in  practice,  a  finite  system 
approximation  is  adequate.  Hence  we  solve  (2.221)  by  the  recursive 
scheme  of  Theorem  XI. 


rvin  * 


Bo  as  not  to  confuse  letters,  let  A, 

Then  the  scheme  Indicates  the  representation  for  </U  (t) 

'L-  (t)  =  f  AnaPda 

«P 

+  j—f  C^vM-^  A' W 


(2.24) 


The  initial  conditions  on  the 


are  obtained  from  the  requirement 


that  ^rrtn  *  A  mt\ 


Hence 


(a. a#) 


C*  (o)  "  S  (*«,(>)  £  Om) 


C.w  *  o 


_  W»  A  .  , 

V^P*H  f*V  f*V  ^  '  =  ^ 


•tc. 


Putting  this  into  (2.221)  gives  first 

(2.261)  ~  c;  W  *  O 


Hence 


(2.271) 


C~(t)  =  S  ("',(>)  S(n>i) 


The  next  equation  obtained  is 


J 


irsr\ 


(2.62)  -  Q  (t)  = 


o C  *C 


r  f  fm>-nc)( /->r*  , 

“)J  V  V^dr<l5 


-oe  -•* 


Cmn 

(o)  *  0 


and  (2. $71),  we  obtain  as  solution  to  (2.262) 
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(2.272) 


C*"n  (t\  = 

W  p'<\.  fa<V».  '  ' 


=  n p, Uft*--*-  <£) 

(rrtl4  nL) 


SV^+P*) 


We  proceed  in  the  aaae  way  to 


oc  °C 


<a  aea>  *  C-m^*0  =  liJrJ' 


*B»  “  oO 


with 


.  (  ftnS-nrHr^+s*)  ppr*  p  «-<•,•»-*  p'*  m-r,„.o7 

L  (ml  +  nx)  LW^«'“'Pi^if,l»  Jj 

*mn  . 

the  initial  condition  that  '-f,***^*  (C)  *  0 


The  aolutlon  to  thia  la  (2.273). 


Cm.> 

f-i-N  - 


•j1  f(™^~r>Pi)(P»+*Vi  )(Pi  4  )  [(m  -  p,)(^t— (n-^,,)fj 

A  1  (m1fnt)[(m-|’,)l+(n-^)1] 

*  £(«"-p.>p«-+  P«) 
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It  is  easily  seen  that  all  of  the  C  ">  will  coabine  to  give, 
for  fixed  initial  conditions,  a  Taylor  series  type  expansion  over  time. 
This  is  because  the  original  equation  (2.221)  had  no  linear  tera  on 
the  right  hand  side. 

Now  the  scheme  (2.24)  will  converge  uniforaly  over  "t  and  A 

for  bounded  "t  and  bounded  .  (This  is  strictly  true  when  only 

a  finite  number  of  A  S  are  used) .  But  a  Taylor  series  does  not  often 
converge  rapidly.  Nevertheless,  the  scheme  (2.24),  when  used  to  obtain 
the  energy  density,  will  perhaps  be  useful  in  studying  the  stability  of 
statistically  described  flows  over  a  small  but  finite  time  interval. 

The  reader  is  again  refered  to  Lorens  (1953)  who  initiated  there  the 
instantaneous  stability  problem. 

The  convergence  problem  being  as  it  is  above,  we  turn  in  the 
next  section  to  a  dissipative  system  where  this  difficulty  is  overcoaw 
in  a  definite  sense. 


(2.3)  Non-Conservative  Turbulence  as  an  All-Time  Problem 

We  envision  a  two-dimensional  viscous  fluid  extending  over 

I*  _  &  'K.  as  oc> 

[  ”  5  00 

(The  three  diaenslonal  problem  would  follow  in  the  saae  way  as  below). 

The  basic  force  equations  have  been  given  in  section  (1.2)  as 
equations  (1.22a,b).  We  will  use 
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(2.31a) 


(2.31b) 


U  h  4.  *  4^ 

<>* 

u  4.  uU 

«>3 


-  J_  If  ^  x/'V’V 
/*  ^x 

— L  if  +  ✓  7  V 

/•  ^ 


Thm  quantities  in  (2.31a,b)  ara  defined  aa  in  (1.22a,b).  The  equatlona 
(2.31a,b)  are  the  aaae  aa  (l,22a,b),  except  that  the  external  field  has 
been  deleted. 


In  addition,  we  still  have  the  equation  of  continuity. 


(2.32) 


fe*  Sf  -® 


This  la  the  sane  as  equation  (1.21). 


Manipulating  (2.31a,b),  and  using  (2.32),  we  obtain 


-T’,p  -(fcH*f)‘*a;77? 

At  this  point  ue  Introduce  Fourier  coefficients. 

P  =  f  (  Pn«.  tlm*  e'"*  Jr. 


-CO  -< 


es  ye 


(  ( 
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A  siailar  expression  obtains  for  W 


There  are  no  boundaries  in  the  problen.  Hence  the  operator  is 
easily  Inverted  in  the  Fourier  donaln.  (2.33)  Implies 

,  x  i  p  -  r  r uriuw.r^-< 

(2.34)  —  Z-  l  J  J 


—  OO  -  o c 


90  nO 


\  iri' 


—  00  -e 

V  oO 


-m  -to 

aquations  (2.31a,b)  go  over  to 


+  a[ Ur‘  ir,li 


=.  ir  p~ 

r 


Oi»\ 


OO  oO 

(2.33b)  ^  J"  [irUm-r,*-*  *  *-s  Wr«-r,A-i]Wrs  A»*Ai 


ss  —  Pmn  —  V  (n'*+  nl)  W 
/° 


mo 


p. 


u, 


VI. 


H.n  Is  expressed  in  tens  of  vl**r>  and  wrnn 
through  (2.34).  Taking  (2.34)  into  account,  the  linear  approximation 


-  55  - 


» 


to  (2.35a,b)  is 


iks*  =  -  •/("'*  *■  »*)  IL„ 

it 

Ji 

The  solution  to  (2.36a,b)  is  of  course 

U_(t)  = 

W^o) 

We  will  not  do  so,  but  could  here  go  through  the  same  procedure 
as  in  section  (2.2),  and  indicated  by  Theorem  II. 

It  is  perhaps  possible  to  see  by  inspection  however,  that  unlike 
the  preceding  problem,  we  will  here  not  get  (for  fixed  initial  conditions) 
power  series  in  time.  Rather,  we  will  obtain  a  series  whose  terms  are 
constants  or  damping  exponentials.  Hence  (2.35a,b)  with  (2.34)  are  dif¬ 
fusion  type  equations.  This  is  because  we  have  deleted  any  external  field 
such  as  the  gravity  field. 

It  might  at  first  be  supposed  that  because  we  have  to  deal  only 
with  damping  exponentials,  that  the  representation  scheme  of  Theorem  II 
would  in  some  way  converge  uniformly  over  all  time.  This  is  unfortunately 
not  true  in  general.  There  exist  not  at  all  pathological  systems  such  that 


(2.36a) 


(2.36b) 
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with  initial  conditions  fixed,  each  term  in  the  representation  series 
will  be  a  damping  exponential;  but  the  series  will  not  converge  as 


^ 


However,  in  our  present  case,  we  have  a  special  situation.  The 
non-linear  terms  are  conservative,  while  the  linear  term  is  dissipative. 
The  total  energy  continuous  decreases  and  asymptotically  goes  to  zero. 
This  implies  that  for  arbitrary  G  >  0  ,  there  exists  a  0 

such  that 


(*•)[]  <  $(£) 
^ [I W-. (*.)!]  *=  s<£) 


implies 


U™  (t)  |  <  fe 


for  all  "t  >  *tc  > 


»nd  I  W „„  (t)  I 


<  e 


for  all 


■b  ^  t, 


In 


addition,  |  ULn  (t)  |  and  (-t)  I  — ^  O  • 

It  is  shown  in  Appendix  B,  that  there  then  exists  a  T(R,e) 


such  that  for  any  R  >  0  and  £,  ■>  O 

—  [  |U„„(o)|  JW„„(o)|]s  R 
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implies 


[|lL.(t)|>|VLit)|]  <  e 

for  all  "t  •>  (R^  €■.  ^ 

Since  for  any  R  and  £  /  A,  and  'T*  (R  Q. )  ,  there  exists 

an  ^  /  a.  approximation  to  the  solution  uniformly  over  all  initial  con¬ 
ditions  bounded  by  R  and  *t  bounded  by  ^  ,  setting  the  approximate 

solution  equal  to  zero  for  ">  I  gives  us  a  representation  scheme 
which  converges  uniformly  over  all  time  at  a  rate  dependent  only  on  the 
bound  on  the  initial  conditions. 

Once  again,  the  special  property  of  the  above  system  is  that  any 
bounded  initial  starting  configuration  damps  to  zero  asymptotically. 

Other  systems  satisfying  the  conditions  of  Theorem  II,  while  at  the  same 
time  displaying  this  property,  can  be  handled  in  the  Bame  way. 

Batchelor  (1960)  has  suggested  that  in  homogeneous  turbulence, 
the  velocity  correlations  become  Gaussian  as  ^  ►  00  regardless 

of  the  form  of  the  initial  distributions.  We  mention  this  as  suggestive 
of  at  least  one  experiment  to  be  undertaken  with  the  above  results. 
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Chapter  III 


(3.1)  Equations  with  Forcing  Functions 

Over  an  Arbitrary  Large  But 
Finite  Time  Interval 

In  the  preceding  chapter,  the  equations  had  analytic  right-hand 
sides,  but  were  without  forcing  functions .  This  chapter  retains  the 
condition  of  analyticity  while  allowing  the  equations  to  possess  a 
forcing  term.  Our  basic  system  in  this  chapter  will  take  the  form 


(3.ii)  =  Ax  { (/*)'k )  + 

d  t. 

where  A  is  an  nxn  matrix,  and  X  ,  and  are  n-vectors. 

^  has  no  linear  dependence  on  X  Also,  if  *f  (O,  )  were 

not  equal  to  zero,  we  could  incorporate  this  term  of  "f  into  ^  . 

Hence  we  explicitly  assume  “  0  .  On  a  component  basis, 

we  can  write  £  as 

0.121)  (.*>■*-)  -  p,y  ('t) '’‘■j.j.  "*■ 

wherein  we  have  employed  the  summation  convention  that  any  repeated 
index  is  to  be  summed  unless  otherwise  specified.  This  convention 
will  be  in  effect  throughout  the  chapter.  Ve  have  supposed  -p  to  have 
a  finite  number  of  terms  for  convenience. 
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We  are  going  to  introduce  a  representation  scheme  which  is  to  hold 
over  any  finite  time  and  for  at  least  some  large  class  of  forcing  functions. 
The  scheme  is  essentially  that  of  Vol terra  Functionals.  We  have  already 
made  mention  of  Vol terra  Functionals  in  the  Introduction. 


We  will  proceed  formally  at  first.  Statements  about  convergence 
will  be  made  later.  The  proofs  are  mathematical  and  left  to  Appendix  C. 

Consider  the  simple  first  degree  scalar  equation 

+  0.*.  =  b*.*  4-  $  Ot ) 


(3.13) 


dt 


(3.13)  i 8  equivalent  to 


x 

(3.M)  *(t)  =  e"***..  +  J  e'<t'‘l)[b*-l(r)+^c,r)]dT 

0 

If  OC  (ii)  is  representable  by  Volterra  Functionals 

*(*)•  K.i-t)  +  jV(t.T)9(r)drr 

tt  ° 

+  (  fK4(t,T. ,TX)^ a)  $(V  A  +  •  •  • 

o  o 


(3.15) 


At  t  =  0  ,  'K  (P)  -  Ko(0)  =  7C 

that  K„  (b )  is  a  solution  to 


It  is  clear 


(3,i«)  4^  +  a  K„(t)  =  b[K.(t)]a  K,(o)  -  x. 
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In  what  follows,  we  adopt  the  attitude  that  Ko(0  is  already 
determined.  This  can  be  done  by  the  methods  of  the  preceding  chapter, 
or  by  any  other  means . 

We  put  (3.15)  into  (3.14).  Tills  is  to  hold  for  all  (t)  in 
some  large  class,  so  we  equate  kernels  of  like  homogeneity  across  the 
equation.  In  this  way  we  obtain 

(K.(4,*r)4(T)dT  = 

0  o 

■t  ±‘ 

+  A  f  (  e-a<t  ~ V)b  K.  (V)  K,  (t',T)  ^  (T)  dTjt', 

0  O 


K,(t,T-)  =  0  for  n-^t. 


This  is  satisfied  by  setting 


K.(t,T) 

(3.171) 


-o.C'fc  -  er) 

e 

4 

+  Jb  [< >' °‘t*  '*  K,  (i',T)  it' 

O 


T 


acts  here  only  as  a  parameter. 


(3.171)  can  be  solved  analytically  over  any  finite  interval 
(VolterTa,  1959;  also  Kolmogorov  and  Fomin,  1957).  The  method  is 
simply  successive  approximations  which  are  shown  to  converge  uni¬ 
formly  over  the  time  interval. 
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(3.172) 


In  the  suae  way,  we  obtain  next 

■fc 


o 

+  A\>  (eaW>K.  (t')  K,  (t'jT.,^)  jt'  , 

e 

T,>  t  or  Tl>t 

T.  and  %  act  aa  parameter a.  Ve  have  again  the  same  aort  of  linear 
integral  equation  for  Ka  aa  for  K,  Notice  that  when  K0  )  =■  O  , 
we  obtain  K(  and  directly.  Ko  (^)  “  O  when  %(p^  =  O  • 

The  expreaaion  for  K 1  ia  no  wore  involved. 


(3.173) 


o 

+  at  K.tt'.'n.T.  ,T»>  Jt'  . 


“  0  T,,Tl  orT,^  t 


Ve  will  not  do  any  wore  of  thia,  but  rather  go  on  to  the  sore 
general  problea  covered  by  equation  (3.11). 

The  equivalent  Integral  equation  formulation  for  (3.11)  la 

t 


(3.18) 


=  eAt*-e  +  [  eA^  *  *f{  )j 

o  J 
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A(t  —  t') 

We  use  (3.18),  but  first  set  ft  =  0  (-fc  —  ) 


to  obtain  on  a  component  basis 


(3.191) 


*Ut)  -  8ij  +  (B;;  (*-*')  ^|(f) 


+  f  BijCt  -O 


+  •  *  •  + 


0  ‘ 

where  It  Is  understood  that  a  repeated  index  is  summed. 

We  now  form  a  functional  representation  scheme  for  'K-  'L  (jt) 
The  repeated  index  summation  convention  continues  in  effect. 


(3.1201) 


* 

■x.lt)  *  lK.(t)+  (  CT)^ 


+  \  f \k>'(±,x,  t»)  (t.)  v.a)  n 


In  the  same  way  as  the  first  example,  the  Introduction  of  (3.1201)  into 
(3.191)  leads  to 


-  63  - 


w 


(3.1211)  'K^T)  *  B  L  K  (t-T) 


+  2  (  6ij(t -f)  K.(vf  K.h(t',*r)  dt' 

•o 

+  3  ^(t-w.i.Cf)  *K.(t')XW  V(t';r)<iV 


t: 


«  j  \a)-  •  Xk  (t»At' 

C 

where  1  K  ^  ?  ^*)  —  0  for  1  ^  t  . 

with  k  and  l  fixed  and  *-  *.  I ,  A  ,  *  *  *  ,  ”**  k  and  T 

can  be  considered  parameters.  (3.1211)  is  a  system  of  linear  integral 
equations.  These  can  be  solved  by  successive  approximations.  The  theory 
for  this  is  essentially  the  same  as  quoted  before  (Volterra,  1959). 

MO  is  the  solution  to  (3.11)  when  there  is  no  forcing 
function  (t)  We  must  suppose  K#(t)  already  determined. 

Again,  if  necessary,  this  can  be  done  through  the  method  indicated  by 
Theorem  II.  Notice  that  if  OC^o)  =0  lKe  (t)  *  0  and 

W.  (*,  T)  can  be  obtained  from  (3.1211)  directly. 


0 

«» -I  I 


•  \  ^‘l/^  / . 1 


t  ..fc 


64  - 


We  next  determine 


(3.1219)  = 


=  \  b,.  (t -Of  *  tct,)tV'  (*’x, )  (t1,  v  it' 

n  •> 


0 

t 


n(n-i) 

J! 


v 

(  BijCt-V)  . 


K.Ct')-  •  •  WK.(t')  % 


+  a  jeij  VV.T,^)  It' 

0 

t 

p 

.  K>  (V) . . . e-  K.(f)  \k>‘  (t‘,  t  T;)  a  t' 


K  ^  (t ,  /T;)  =0  tor  >  t  or  'T’t  >'t  • 


where 
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Notice  again  that  if  the  (o)  *  O  >  then  *  K0("t)  *  0 


and  '  *'(fc/t;)  T,.)  can  be  determined  directly.  Also,  both 

i 

and  r\t  are  obtained  by  inverting  the  same  linear  operator  when 

K.(t)  ^  O  for  all  t  Thus  even  for  this  very  complicated 

and  general  case,  one  tan  see  that  to  obtain  any  order  kernel, 


1  .  .W 


K  ,*  *  •  W, 


,  the  same  linear  operator  is  to  be  inverted  independent 


of  n  . 

1  N,  fe,  k, 

Ve  will  not  write  out  the  expression  for  ft  or  the  higher 

order  kernels.  One  proceeds  in  the  same  way  as  above,  but  of  course  obtains 
increasingly  more  complicated  and  tedious  expressions. 

Let  us  consider  Ke(0  in  greater  detail.  As  already  mentioned, 

1  K.Ct)  is  the  component  of  the  solution  when  the  forcing 

function  n-vector  O  (t )  m  Q  .  As  such,  by  the  previous  chapter,  K0C^) 


is  expandable  as 


The  expansion  converges  uniformly  over  all  bounded  time  and  initial 
conditions.  If  the  problem  is  non-linear,  then  correlations  down 
an  ensemble  Involving  the  solution  components  will,  at  least  formally, 
be  given  in  terms  of  ensemble  averages  of  products  of  Initial  position 
components  and  forcing  function  components. 

The  legality  of  the  formal  procedure  employed  above  is  given 
by  Theorem  III  below.  In  order  to  state  this  theorem,  we  first  define 
a  phase  space.  The  space  is  2,o+  I  dimensional.  A  point  in  the 
phase  space  is  given  by  the  components 

(  (°)>  *  *  *  >  (°)>  ‘J.CO,  '*  '  >  ^"(0)  *  ^ 

*  . 

where  unless  (  |  (T)  -  U;  (T’jfdT*  •  0  . 

o 

The  differential  equation  (3.11)  can  be  thought  of  as  an  operator  which 
assigns  to  each  point  of  the  phase  a  real  number. 

A  subset  <Jx  X  Qj  of  the  phase  space  is  the  set  of  all 
points  such  that 

ostfij 

K  ,  L.  " 

|  (t)  I  -  ,  C  -  [  }  *  J  O 

for  O  ^  “t  —  cL 

Now  we  can  state  the  theorem. 
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Theorem  III 


For  arbitrary  but  finite  d  >  A  ,  and  G)  ,  the  representation 
scheme  (3.1101)  converges  to  the  solution  of  (3.11)  uniformly  over 

d*  A  *  G 

The  proof  is  in  Appendix  C. 


(3.2)  More  About  All-Time  Representations  and  Concluding  Remarks 

In  Chapter  II,  the  simple  condition  that  an  unforced  system  damp 
asymptotically  to  zero  allowed  an  approximation  scheme  to  converge  uni¬ 
formly  over  all  time.  Here,  where  we  are  specifically  interested  in 
systems  with  forcing  functions,  we  are  unable,  at  least  at  this  time, 
to  obtain  any  corresponding  result. 

The  Introduction  shows  that  if  an  unforced  system  does  not  damp 
asymptotically  to  but  one  limit  point,  then  the  same  system  with  forcing 
cannot  in  general  have  an  all-time  Vol terra  functional  representation. 

Unfortunately  the  converse  is  not  true.  Consider  the  system 
suggested  by  Professor  Edward  N.  Lorenz. 

=  -  OC,  -  +  £  (0 

=  —  +■  %, 


(3.21) 


d-t 

dfc 
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When  4~(0  is  set  equal  to  zero,  (3.21)  can  easily  be 


manipulated  into 

(3.22)  1  A-(TL,2+  %Z)  =  -  (<  +  %,) 

A  cl  t 


From  this  it  follows  that  every  solution  of  the  unforced  system  damps 
asymptotically  to  zero. 


and 


However,  when  (fc )  =  ^  ,  the  points  ,  =  I  ,  %-z.  ~  l) 

(ic,  *  |  *  —  l)  are  stable  limit  points.  The  point 

**  ^>^4.  is  an  unstable  limit  point.  The  behavior  of 

the  system  at  "fc  «  °°  is  discontinuous  with  respect  to  initial 
conditions,  and  hence  an  all-time  representation  which  would  converge 
uniformly  over  all  time  and  arbitrarily  large  but  bounded  forcing 
functions  and  initial  conditions  is  beyond  our  grasp  at  the  present 
time . 


Nevertheless,  it  should  be  emphasized  that  those  cases  where 
statistically  stationary  forcing  functions  actually  produce  asympto¬ 
tically  stationary  solution  statistics  for  some  definite  initial 
condition,  are  approachable  by  the  finite  time  representation  scheme 
of  section  (3.1)  on  a  computational  basis. 

Suppose  then,  that  computationally  after  some  finite  time,  we 
are  able  to  obtain  a  reasonably  good  estimate  to  the  steady  statistics 
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of  the  solution  for  a  stationary  forcing  function  and  a  particular  initial 
condition.  Now  each  state  of  the  system  within  the  finite  time  interval 
can  be  considered  a  new  initial  condition  with  the  same  stationary  ensemble 
of  forcing  functions.  Hence  for  each  point  on  the  finite-time  trajectory, 
and  now  considered  as  an  initial  condition,  the  stationery  statistics  are 
in  all  cases  the  same . 

The  theory  for  all-time  representations  of  systems  with  forcing 
functions  is  admittedly  not  yet  at  a  stage  at  which  one  is  satisfied. 
However,  it  is  hoped  that  by  machine  experiments,  the  above  theory  will 
enable  one  to  mark  of  those  sections  of  a  phase  space  which  under  an  ergodic 
ensemble  of  forcing  functions  are  transformed  by  the  differential  equation 
operator  within  themselves. 

The  effort  involved  in  such  a  project  must  of  necessity  be  great. 

Even  for  problems  of  the  kind  considered  in  Chapter  II,  where  the  theory 
is  more  developed,  any  practical  problem  will  require  considerable  labor. 
This  is  an  unfortunate,  but  certainly  to  be  expected,  aspect  of  non-linear 
analysis.  Non-linear  problems  can  present  difficulties  which  do  not  exist 
for  linear  problems.  We  shall  perhaps,  simply  have  to  become  used  to  paying 
more  for  results  in  the  non-linear  case. 
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Appendix  A 


The  equation  first  in  question  is  of  the  form 


(Al) 


^  ~  A%  +  G,Cfc)  %  +  G1(t)fC%)  +  %  Ct) 


are 


where  'X.(t)  and  (jt)  are  n-vectors,  (-t)  and  GijX'fc) 

continuously  time  dependent  nxn  matrices,  /\  is  a  constant  nxn  matrix, 
and  f(x)  is  an  n-vector  whose  components  are  second  degree  or  higher 
order  polynomials  in  the  components  of  “X 


At  t  =  0  ,  X (o)  X0  is  the  necessary  initial  condition. 

(Al)  is  equivalent  to 

t 

•*-(*)  =  eAt-x„  +  (  fcAtt'  r)G,C'T')  -*■('>')  d  T 

(A2)  o 

We  are  supposing  that  X^t)  —  0  is  an  asymptotically  stable 

limit  point.  Hence  the  eigenvalues  of  A  all  have  negative  real  parts. 


Every  term  of 


A  (t  -  T) 


is  of  the  form 


Mt  -r) 


U-T) 


where, the  real  part  of  A  is  negative  (Lefschetz,  1957).  Each  such 

» . 

term  is  bounded  and  absolutely  integrable. 
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We  use 


to  denote  the  norm  of  a  vector  or. matrix. 


Unless  expressly  stated,  the  norm  of  a  vector  or  matrix  will  be  taken 
to  be  the  maximum  of  the  component  magnitudes. 

i 

Then 


*  i II 


A  (+  -  <r) 


d‘T 


exists,  is  finite, 


and  we  denote  it  by  H 

The  nature  of  F  indicates  that  there  is  a  region  about 

the  origin  defined  by  |[  OL  ||  <  R  ,  such  that  for  X.  in  this 

and 


region. 


.  IK  Ml  ^  F 


IK  (*.)  -  4  (nOH  s  L  II  *■ '  —  **-1 


where  in  addition,  F  — ^  O  as  R  1  and  — ►  O  with  R 

F"  4s  the  bound  for  F  (.'*-)  and  L_  is  called  a  Lipschitz  constant. 

We  next  must  set  up  a  particular  normed  space.  Let  C  ( 
be  the  set  of  continuous  n-vectors,  4*(t)  ,  on  a  closed  interval 

tc  ~  "t  —  cL  J  .  That  is,  each  component  of  ^  (t)  i8  a  con¬ 
tinuous  function  of  time  on  L°,d]  The  norm  of  F  (t)  will  be 

taken  as  the  greatest  magnitude  of  any  component  for  any  "t  in 
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To  be  more  precise, 


ll$\t)||=  r{r[if'wi]} 

We  make  the  additional  restriction  that  for  (p*  ft)  to  belong  to 
the  set  C*(>)  , 

|l£*(t)||  <  b  <=ft 


VI th  this,  C  (.lo)  is  a  complete  metric  apace  (Kolmogorov  and 

Fomin,  1957). 

Ve  wish  to  show  that  when  r(t)  is  substituted  into  the 
right  side  of  (A2),  we  have  a  contraction  mapping.  A  mapping  TV)  of 

a  metric  space  X  into  a  metric  space  Y  is  said  to  be  a  contrac¬ 
tion  supping  if  for  all  %  ,  and  in  X  > 


tvick-o  -  we-tOll  <  <*ik.  - 


where  is  a  positive  number  ) 

Consider  the  mapping  defined  for  [o  <  -t 

f*(t)  -  eAti.+  f 

(A3)  o 

+  [ret)]jT  +  feAtl  "T)a(T)J  T 
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I 

i 


which  is 


v  *w  -  y«)  i|  =  $rp  j 5r  [  i,y*w  -  „  <  w  l]  •  - 

=  |  [e.A<t '  CT)  ^  { T)  -  *  <.T)]  J  r 

<? 

+  [eMt  "',‘t1CT)(<[^*(T)]-f[w^'rt]  J| 

*  n*H[l|G..HIIG»llL]lL^-.rl 


where 


“  t'l/tOjdf]  [H  Gy^)  H]  ,  V  =  I  and  9. 


Then  for 


II  G,  II 


II  &  JI 


simply  bounded,  there  exists  an  R  forcing  L_  ( R  )  to  be  sufficiently 


small  so  that  n 


H QI6.II+  L||GJ|]  «  \  Hence,  (A3)  is 


a  contraction  mapping. 


We  next  show  that  this  mapping  takes 


C*(fc) 


into  itself. 


From  (A3),  at  the  time  , 
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Here 


fV)||  S  nils'll  Ml  +  IK 

+  nx0l*.A‘Hll6Jl'r^ 

cU 

;  i  •  '  ’  '  '  0  • 

II  ^ 


As 


+  n  lie 

0 


2 


_  5w'P 

~  t 


As  mentioned  above,  there  is  a  bound  3  such  that 


At'  II  ^ 

e.  II  - 

B 

for  all  t  in  ^0  C>C3  j 

Thus  |||'*(V)j|  ^  hBIKH  +  nH  11^(1 

+  h‘HDNIt  +  II  ^JIf] 

Since  F"  — >  0  as  b  ,  for  1 1  Xj,  1 1  ,  J  |  G ,  j  |  and  [1^-11 

small  enough,  there  exists  b  such  that  ||Y*(Ol|  c  b 
for  all  This  shows  that  the  image  of  the  contraction  mapping 

given  by  (A3)  on  C*  (b)  is  in  C*(b)  for  some  b  with 
suitable  restrictions  on  the  initial  conditions,  the  matrix  G,  (t) 
and  the  forcing  function  ^  (4) 
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There  is  a  contraction  napping  theorem  (Kolmogorov  and  Fomin, 
1957)  which  ways  that  if  W  is  a  contraction  mapping  of  the  complete 

metric  space  C.*(b)  into  itself,  then  the  equation 

possesses  a  unique  solution.  Further,  (j)  can  be  found  by  successive 

approximations .  That  is  if  , ^  is  any  element  of  C*  (b)  ,  and 

we  define 


,  A  *  wM]  = 


then 


It*.  m n  [,$] 


etc. 


This  means  that  for  (A3)  we  can  define 


,  .  M  (  ft(t-T)  .  .  J<r 

*(t)  =  e  +  e  i  )<4T 


and  recursively  obtain 


„..-%(*)  =  eAtt.<(+feA(t'T,£i.CT)nt(T)  JT 

o 

4  fe^-^etKt^erfldT  +  [e**kJ,\tT)aT 

The  successive  approximations  approach  ,  the  solution  vector, 

uniformly  over  [0,  J]  That  is,  for  any  £  there  exists  an 

N  (G)  such  that  for  all  n  ^  W  (O 
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*tt)  -  „  X  (fc)  l|  <r  e- 


for  all  t 


defined  only  on 


Finally,  although  the  functions  In  c*(b) 

[o,i]  , 

(A3)  as  a  contraction  mapping  of  c*0>)  into  itself  have  none  of 
them  been  dependent  on  cl  •  Thus  the  successive  approximations  converge 
to  the  solution  vector  uniformly  over  all  time. 


have  been  supposed 
the  conditions  shown  sufficient  to  insure 


One  generalization  follows  easily.  It  has  been  required  of 

G> .  (t )  only  that  each  component  be  bounded  over  time.  If  equa¬ 
tion  (Al)  is  replaced  by 

(A4,  #  -  A*  +  G,(t)*  +  G.COCiO) 

at 

4- Gj(^ ){*('*')  +•  *  •  •  •+  G»*  (4  )■£«(*) 

where  each  ,  ...  ,  Ca  n  i*  bounded  uniformly  over 

time,  it  is  clear  that  the  above  results  are  still  valid. 


The  vector  sum 

(*)  +  *  *  *  +  L%)  can  be  combined 

into  the  single  vector  H[t;  *(*)]  Each  component 

of  H  [+,  *]  will  be  a  finite  polynomial  of  degree  2  or  greater 
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in  the  components  o f  %,  ,  and  the  coefficients  will  be  uniformly  bounded 

functions  of  time.  With  this,  (A4)  becomes 

(as)  =  A*  +  GOO*  +  H  [*,**]  + 


Another  generalization  can  be  obtained.  Consider  the  linear  equation 


(A6) 


%  =  8  <*>*+*<*) 


If  the  solution  to  (A6)  is  bounded  for  every  bounded  initial  condition 

and  every  bounded  Cj  (_"0  >  then  the  same  kind  of  results  as  obtained 

above  hold  for 


<«>  4*-  =  B(t)«  +  H  [*,*-]  +  3  (*) 


We  will  not  go  through  a  proof,  but  simply  state  a  result  which  allows  one 
to  use  the  contraction  mapping  method  as  before. 


<A8) 


(A7)  is  equivalent  to 

fc(t)  =  XWx*+ 


where 


+  XC-t)  (V'(T)^CT) 

o 

is  the  solution  matrix  for  (A6)  with 


JT 


set  equal 


to  zero. 
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Under  the  condition  that  (A6)  give  bounded  solution*  tor  bounded 


forcing  functions,  Bellman  (1948)  has  shown  that 

t 

(|x(f)>r,(T)||jT  is  bounded  for  all  *t  , 

c 

and  that  X  ('k)||  =  0  •  This  last  implies  of  course 

II X  (Oil  is  also  bounded  for  all  time  since  Xl±)  Is 


that 


continuous , 


The  contraction  mapping  method  goes  through  as  before,  and  we 
are  now  able  to  summarize  our  results  in  the  following  theorem. 


Theorem 


If  for  equation  (A6) 


(A6) 


cU 


^  (-t) 


every  bounded  forcing  function  ^fc)  ,  with  bounded  initial  con¬ 
ditions  ,  produces  a  bounded  solution,  then  there  exists 

an  R  >  0  and  a  >  O  such  that  for  ||  X-e>  ||  <  R  and 

II  $<^11  <  $  for  all  "fc  ,  the  equation  (A7) 


(A7) 


it  =  BWt  +  H  (>,*■]  + 


can  be  solved  by  successive  approximations.  The  approximations  are 
determined  by  the  linear  equation 


<A9) 


d  tr 


(*) 


with  =  TCe  ;  and  n  *.  (fc) 

converges  uniformly  over  all  time  to  the  solution  OC 

A  special  but  important  case  arises  when  BW  is  a  constant 
matrix  plus  a  pertubation  time  dependent  matrix* 

If  the  eigenvalues  of  A  all  have  negative  reaL  parts,  there  exists 
a  G?  O  such  that  for  ||  Gl  (^)  |l  ^  £l  every  solution  of 


(A10) 


—  Ax-  +  G  (t)  1C  4-  Ct) 


is  bounded  for  bounded  and  ;  and  hence  the  hypothesis 

of  the  theorem  is  satisfied. 
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Appendix  B 


Asymptotically  Stable  Systems 


Ve  will  deal  with  a  system 


(Bl) 


=  -f  ) 


where  iL  and  are  n- vectors  and  •fCo.-t)  =  o  Further, 

it  is  supposed  that  the  solution  'X.  (,-fc)  to  (Bl)  is  asymptotically 
stable. 

Let  ft  be  an  arbitrary  but  fixed  bound  on  the  initial  conditions. 
That  is  . 

II  *.(0)11  «  ”?*  [I  *i(c)|]  <  R 

Then  the  set  S(R)  of  Initial  conditions  defined  by  || -*(0)11  <R 
is  compact. 

Let  be  any  point  in  S(R)  By  supposition,  there  exists 
.  TCp.Va)  such  that  the  trajectory  originating  at  p 

at  ~t  =■  0  is  within  of  zero  for  all  *fc  T(p.  s/a.)  . 

By  known  results  (Lefschetz,  1957),  there  exists  an  open  neighborhood 

N(f  ,%)  with  the  property  that  all  points  in  N(p)  VO 


81 


at  "t  »  0  are  within  ^ /  9-  ,  at  t  a  >  of  the  trajectory 

originating  at  p  Hence  all  in  IV  C.'pi  ^/a)  are  within 

£  of  zero  at  ~fc  »  *T 

For  each  point  p  in  Sts')  there  exists  such  a  neighbor¬ 
hood  |V  C  f  j  •  Since  is  compact,  a  finite  number 

of  these  neighborhoods  cover  S(fi)  It  follows  that  for  arbi¬ 

trary  ^  >  O  and  W  O  ,  there  exists  a  t.CS.R) 
such  that  all  trajectories  “X.  (t)  ,  with  ||  ||  ^  R  , 

end  up  uniformly  ||  ^  S  for  all  "t  "fc,  . 
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Appendix  C 


The  fundamental  equation  with  which  we  deal  is 


(Cl) 

<A  x 

(-0 

where 

,  and 

are  n-vectors. 

is  analytic 

in 

>  *  •  * )  /*-n  >  ) 

However,  we  will  assume  for  convenience 

that 

the  form  of  the  L  +h 

component  of  *f 

is 

(C2) 

4-  (t)-tv  + 

• 

f  ^ 

+  •••  +  +:, 
i* 

For  (C2),  and  the  reat  of  Appendix  C,  the  summation  convention  applies. 


For  bounded  time,  the  ^  *  *  *  *  "fy*  '  '  '  ^ 


are  bounded 


functions  of  time. 


The  problem  1b  defined  over  the  finite  time  interval  ■ 

It  is  aseumed  that  over  [o)d]  ,  bounded  forcing  functions  produce 

bounded  solutions  to  (Cl).  Let  G)  be  the  bound  for  Qy  6^)  ,  and 
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R  the  bound  for  (4;)  .  That  la, 


[|^U)l]  -  R  for  all  [c  -  t-ci  ] 

[l  Ji-W  l]  ~  Gl  for  all  [o—  -t  -  <i] 


t  ®  1^  <  •  •  j  11 


There  la  then  a  bound  F"  for  Cx ;  "k)  • 

[|-fl<M>l]  ±  F  «or.U  [0*H 


and  all 


1  ~  *  )  "  ‘  "J  ° 

I  —  G 
i  = 


Further,  there  exlsta  a  Llpschitz  constant  L_  such  that 

<  L  -j* 

at  any  "fc  In  [©>*0  and  all  fc-  ,  VJ.  bounded  by  R 
Nov  (Cl)  is  equivalent  to 


t  t 

<c3)  x.(t)  *  x0  +  [xC'T)^‘r]tl'T  f  j'^(.rr)<lrr 


We  wish  to  show  that  the  right  side  of  (C3)  defines  an  operator  which  is 
continuous  on  a  certain  topological  space  to  be  defined  later. 
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Consider  first  the  quantity  [x(t)  -  ^  ( b-t, )  ]  ,  where  ^(i.) 


is  defined  by 


•t,  t, 

<C4)  ^(t,)  =  +  1 4 [3 IT) , “T J  <*T  +  [h(Tr)JT 


Let,  for  definiteness,  "t  (  2  "fc  Then  with  the  above  defini¬ 

tions  of  bounds,  the  following  inequality  will  hold. 


(C5) 


+  IJ  [gi(T)-kCT)]  i 

o 

+ l  [i  j  j « -  *,(')iK  +  (F +Ci/H‘  -  *■) 

(C5)  suggests  a  topology  for  the  space  of  forcing  functions.  We 

say  that  Vi  (t )  is  in  an  &  neighborhood  of  a  (^)  if  and  only  if 
k  * 

|  ([3.CT)  -kMJj't  |  <  e 

for  all  L  and  any  O. k]  in  the  fundamental  interval  fc^dj  . 

* 

Actually,  this  is  a  well  known  topology,  and  is  called  the  weak  topology 
Induced  on  L'  t°,  J]  It  is  also  a  known  result  that  the  set 
of  all  L‘  [c,a]  integrable  functions,  (t  )  ,  for  which 

<3.  <v>  |  <  G,  for  all  ^  in  Co,  d] 


and  all  L 
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is  a  compact  set  under  the  weak  topology  defined  above.  (Dumford  and 
Schwartz ,  1958;  corollary  IV  8.11). 

We  return  to  (C5)  and  restrict  to  be  in  [c,  x]  where 
X  L  =  °<  •<  I  Notice  that  since  (  t  ,  ^  is 

continuous  on  [o,d]  ,  it  is  uniformly  continuous  there. 

Now  let  an  arbitrary  £ (  >  C-  be  chosen.  Then  there  exists  £  >  O 
that  I  JJL  (t)  “*  \  <  ^  i 


such 


for  all 


whenever 


t  -  t ,  <  s 


*fc  —  "t  (  |  ^  S  Hence  for 

and  all  ~t  in  [^O  j  d  j  t  and  with  |  (p)  |  ^  £  a. 


for  all  l  ,  and 
and  all  t ,  in  O  ^  "t  J  , 

t|  (*)->}  at. >1  < 


for  all  W 


£,4-  (  f  CQ  £ 

I  -  •< 


which  is  <  6  for  £,  ^  6.^  ^  €.j  and  £  chosen  small  enough.  ^  ( 
and  ,  do  not  depend  on  "fc 

We  can  break  [c,i]  into  a  finite  number  of  overlapping 

intervals  each  of  length  no  greater  than  X  The  immediately  preceding 
analysis  can  be  produced  on  each  sub-interval.  All  this  implies  that 
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whenever 


(C6a,b,c) 


for  arbitrary  £  >  0  ,  there  exists  a  $  such  that 

I  (t)  -  |  ^  €•  for  all  l  at  any 

in  [Oj  d  ]  whenever 

<C6a,b,c)  |  Co)  -  3i(o)|  <  £  for  all  i 

+  <  S 

I  ([gif')  -  <  £ 

o 

for  all  l  and  all  *fc  in  O  >  d  J 

The  product  space  <S  defined  as  the  aet  of  (2n+l)-vectors 

(t,  x.Co),-  •  •  ,  *..,C j  fy) 

is  given  the  topology  indicated  by  (C6a,b,c).  This  is  a  product 
topology  on  a  product  space.  Hence  the  set  X  A  X  G|  of 

points  in  S  such  that 

o<  t  <  a 


X-L  C°)  I  -  A 

3i  Wl  s  G 


for  all  l 


for  all  l 


and  all  "fc  in  £0^  dj 


is  a  compact  set  under  the  product  topology  defined. 
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It  is  an  immediate  consequence  of  Brilliant's  (1958)  results  that 
the  Volterra  functional  polynomials 

d 

«.[*,*-]  +  fk!  51  (t)jt 


0 

d 


•  3;,  (T)--  - 

are  continuous  on  ^  with  respect  to  the  product  topology  defined 
through  (C6a,b,c).  Since  d  ^  A  *  G  is  compact,  and  since  it 
is  clear  that  the  functional  polynomials  separate  points  of  S  ,  by 
invoking  the  Stone-Weierstrass  theorem,  we  can  conclude  that  the 
solution  to  (Cl)  can  be  approximated  uniformly  over  cl  ^  A  ^  Gi 

by  a  finite  system  of  Volterra  functional  polynomials. 
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